A Configurable Accelerator for Keyword Spotting Based on Small-Footprint Temporal Efficient Neural Network
نویسندگان
چکیده
Keyword spotting (KWS) plays a crucial role in human–machine interactions involving smart devices. In recent years, temporal convolutional networks (TCNs) have performed outstandingly with less computational complexity, comparison classical neural network (CNN) methods. However, it remains challenging to achieve trade-off between small-footprint model and high accuracy for the edge deployment of KWS system. this article, we propose based on modified efficient (TENet) simplified mel-frequency cepstrum coefficient (MFCC) algorithm. With batch-norm folding int8 quantization network, our achieves 95.36% Google Speech Command Dataset (GSCD) only 18 K parameters 461 multiplications. Furthermore, following hardware/model co-design approach, an optimized dataflow configurable hardware architecture TENet inference. The proposed accelerator implemented Xilinx zynq 7z020 energy efficiency 25.6 GOPS/W reduces runtime by 3.1× compared state-of-the-art work.
منابع مشابه
Compressed Time Delay Neural Network for Small-Footprint Keyword Spotting
In this paper we investigate a time delay neural network (TDNN) for a keyword spotting task that requires low CPU, memory and latency. The TDNN is trained with transfer learning and multi-task learning. Temporal subsampling enabled by the time delay architecture reduces computational complexity. We propose to apply singular value decomposition (SVD) to further reduce TDNN complexity. This allow...
متن کاملSmall-footprint Keyword Spotting Using Deep Neural Network and Connectionist Temporal Classifier
Mainly for the sake of solving the lack of keyword-specific data, we propose one Keyword Spotting (KWS) system using Deep Neural Network (DNN) and Connectionist Temporal Classifier (CTC) on power-constrained small-footprint mobile devices, taking full advantage of general corpus from continuous speech recognition which is of great amount. DNN is to directly predict the posterior of phoneme unit...
متن کاملConvolutional neural networks for small-footprint keyword spotting
We explore using Convolutional Neural Networks (CNNs) for a small-footprint keyword spotting (KWS) task. CNNs are attractive for KWS since they have been shown to outperform DNNs with far fewer parameters. We consider two different applications in our work, one where we limit the number of multiplications of the KWS system, and another where we limit the number of parameters. We present new CNN...
متن کاملConvolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting
Keyword spotting (KWS) constitutes a major component of human-technology interfaces. Maximizing the detection accuracy at a low false alarm (FA) rate, while minimizing the footprint size, latency and complexity are the goals for KWS. Towards achieving them, we study Convolutional Recurrent Neural Networks (CRNNs). Inspired by large-scale state-ofthe-art speech recognition systems, we combine th...
متن کاملDeep Residual Learning for Small-Footprint Keyword Spotting
We explore the application of deep residual learning and dilated convolutions to the keyword spotting task, using the recently-released Google Speech Commands Dataset as our benchmark. Our best residual network (ResNet) implementation significantly outperforms Google’s previous convolutional neural networks in terms of accuracy. By varying model depth and width, we can achieve compact models th...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2022
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics11162571